Predictors of follow-up care for critically-ill patients with seizures and epileptiform abnormalities on EEG monitoring.

OBJECTIVE: Post-hospitalization follow-up visits are crucial for preventing long-term complications. Patients with electrographic epileptiform abnormalities (EA) including seizures and periodic and rhythmic patterns are especially in need of follow-up for long-term seizure risk stratification and medication management. We sought to identify predictors of follow-up. METHODS: This is a retrospective cohort study of all patients (age ≥ 18 years) admitted to intensive care units that underwent continuous EEG (cEEG) monitoring at a single center between 01/2016-12/2019. Patients with EAs were included. Clinical and demographic variables were recorded. Follow-up status was determined using visit records 6-month post discharge, and visits were stratified as outpatient follow-up, neurology follow-up, and inpatient readmission. Lasso feature selection analysis was performed. RESULTS: 723 patients (53 % female, mean (std) age of 62.3 (16.4) years) were identified from cEEG records with 575 (79 %) surviving to discharge. Of those discharged, 450 (78 %) had outpatient follow-up, 316 (55 %) had a neurology follow-up, and 288 (50 %) were readmitted during the 6-month period. Discharge on antiseizure medications (ASM), younger age, admission to neurosurgery, and proximity to the hospital were predictors of neurology follow-up visits. Discharge on ASMs, along with longer length of stay, younger age, emergency admissions, and higher illness severity were predictors of readmission. SIGNIFICANCE: ASMs at discharge, demographics (age, address), hospital care teams, and illness severity determine probability of follow-up. Parameters identified in this study may help healthcare systems develop interventions to improve care transitions for critically-ill patients with seizures and other EA.

Automated Extraction of Stroke Severity from Unstructured Electronic Health Records using Natural Language Processing.

BACKGROUND: Multi-center electronic health records (EHR) can support quality improvement initiatives and comparative effectiveness research in stroke care. However, limitations of EHR-based research include challenges in abstracting key clinical variables from non-structured data at scale. This is further compounded by missing data. Here we develop a natural language processing (NLP) model that automatically reads EHR notes to determine the NIH stroke scale (NIHSS) score of patients with acute stroke. METHODS: The study included notes from acute stroke patients (>= 18 years) admitted to the Massachusetts General Hospital (MGH) (2015-2022). The MGH data were divided into training (70%) and hold-out test (30%) sets. A two-stage model was developed to predict the admission NIHSS. A linear model with the least absolute shrinkage and selection operator (LASSO) was trained within the training set. For notes in the test set where the NIHSS was documented, the scores were extracted using regular expressions (stage 1), for notes where NIHSS was not documented, LASSO was used for prediction (stage 2). The reference standard for NIHSS was obtained from Get With The Guidelines Stroke Registry. The two-stage model was tested on the hold-out test set and validated in the MIMIC-III dataset (Medical Information Mart for Intensive Care-MIMIC III 2001-2012) v1.4, using root mean squared error (RMSE) and Spearman correlation (SC). RESULTS: We included 4,163 patients (MGH = 3,876; MIMIC = 287); average age of 69 [SD 15] years; 53% male, and 72% white. 90% patients had ischemic stroke and 10% hemorrhagic stroke. The two-stage model achieved a RMSE [95% CI] of 3.13 [2.86-3.41] (SC = 0.90 [0.88-0. 91]) in the MGH hold-out test set and 2.01 [1.58-2.38] (SC = 0.96 [0.94-0.97]) in the MIMIC validation set. CONCLUSIONS: The automatic NLP-based model can enable large-scale stroke severity phenotyping from EHR and therefore support real-world quality improvement and comparative effectiveness studies in stroke.

Guidelines for Seizure Prophylaxis in Adults Hospitalized with Moderate-Severe Traumatic Brain Injury: A Clinical Practice Guideline for Health Care Professionals from the Neurocritical Care Society.

BACKGROUND: There is practice heterogeneity in the use, type, and duration of prophylactic antiseizure medications (ASMs) in patients with moderate-severe traumatic brain injury (TBI). METHODS: We conducted a systematic review and meta-analysis of articles assessing ASM prophylaxis in adults with moderate-severe TBI (acute radiographic findings and requiring hospitalization). The population, intervention, comparator, and outcome (PICO) questions were as follows: (1) Should ASM versus no ASM be used in patients with moderate-severe TBI and no history of clinical or electrographic seizures? (2) If an ASM is used, should levetiracetam (LEV) or phenytoin/fosphenytoin (PHT/fPHT) be preferentially used? (3) If an ASM is used, should a long versus short (> 7 vs. ≤ 7 days) duration of prophylaxis be used? The main outcomes were early seizure, late seizure, adverse events, mortality, and functional outcomes. We used Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology to generate recommendations. RESULTS: The initial literature search yielded 1998 articles, of which 33 formed the basis of the recommendations: PICO 1: We did not detect any significant positive or negative effect of ASM compared to no ASM on the outcomes of early seizure, late seizure, adverse events, or mortality. PICO 2: We did not detect any significant positive or negative effect of PHT/fPHT compared to LEV for early seizures or mortality, though point estimates suggest fewer late seizures and fewer adverse events with LEV. PICO 3: There were no significant differences in early or late seizures with longer versus shorter ASM use, though cognitive outcomes and adverse events appear worse with protracted use. CONCLUSIONS: Based on GRADE criteria, we suggest that ASM or no ASM may be used in patients hospitalized with moderate-severe TBI (weak recommendation, low quality of evidence). If used, we suggest LEV over PHT/fPHT (weak recommendation, very low quality of evidence) for a short duration (≤ 7 days, weak recommendation, low quality of evidence).

Immediate and long-term management practices of acute symptomatic seizures and epileptiform abnormalities: A cross-sectional international survey.

OBJECTIVES: Acute symptomatic seizures (ASyS) and epileptiform abnormalities (EAs) on electroencephalography (EEG) are commonly encountered following acute brain injury. Their immediate and long-term management remains poorly investigated. We conducted an international survey to understand their current management. METHODS: The cross-sectional web-based survey of 21 fixed-response questions was based on a common clinical encounter: convulsive or suspected ASyS following an acute brain injury. Respondents selected the option that best matched their real-world practice. Respondents completing the survey were compared with those who accessed but did not complete it. RESULTS: A total of 783 individuals (44 countries) accessed the survey; 502 completed it. Almost everyone used anti-seizure medications (ASMs) for secondary prophylaxis after convulsive or electrographic ASyS (95.4% and 97.2%, respectively). ASM dose escalation after convulsive ASyS depends on continuous EEG (cEEG) findings: most often increased after electrographic seizures (78% of respondents), followed by lateralized periodic discharges (LPDs; 41%) and sporadic epileptiform discharges (sEDs; 17.5%). If cEEG is unrevealing, one in five respondents discontinue ASMs after a week. In the absence of convulsive and electrographic ASyS, a large proportion of respondents start ASMs due to LPD (66.7%) and sED (44%) on cEEG. At hospital discharge, most respondents (85%) continue ASM without dose change. The recommended duration of outpatient ASM use is as follows: 1-3 months (36%), 3-6 months (30%), 6-12 months (13%), >12 months (11%). Nearly one-third of respondents utilized ancillary testing before outpatient ASM taper, most commonly (79%) a <2 h EEG. Approximately half of respondents had driving restrictions recommended for 6 months after discharge. SIGNIFICANCE: ASM use for secondary prophylaxis after convulsive and electrographic ASyS is a universal practice and is continued upon discharge. Outpatient care, particularly the ASM duration, varies significantly. Wide practice heterogeneity in managing acute EAs reflects uncertainty about their significance and management. These results highlight the need for a structured outpatient follow-up and optimized care pathway for patients with ASyS.

Identifying inpatient hospitalizations with continuous electroencephalogram monitoring from administrative data.

BACKGROUND: Continuous electroencephalography (cEEG) is increasingly utilized in hospitalized patients to detect and treat seizures. Epidemiologic and observational studies using administrative datasets can provide insights into the comparative and cost effectiveness of cEEG utilization. Defining patient cohorts that underwent acute inpatient cEEG from administrative datasets is limited by the lack of validated codes differentiating elective epilepsy monitoring unit (EMU) admissions from acute inpatient hospitalization with cEEG utilization. Our aim was to develop hospital administrative data-based models to identify acute inpatient admissions with cEEG monitoring and distinguish them from EMU admissions. METHODS: This was a single center retrospective cohort study of adult (≥ 18 years old) inpatient admissions with a cEEG procedure (EMU or acute inpatient) between January 2016-April 2022. The gold standard for acute inpatient cEEG vs. EMU was obtained from the local EEG recording platform. An extreme gradient boosting model was trained to classify admissions as acute inpatient cEEG vs. EMU using administrative data including demographics, diagnostic and procedure codes, and medications. RESULTS: There were 9,523 patients in our cohort with 10,783 hospital admissions (8.5% EMU, 91.5% acute inpatient cEEG); with average age of 59 (SD 18.2) years; 46.2% were female. The model achieved an area under the receiver operating curve of 0.92 (95% CI [0.91-0.94]) and area under the precision-recall curve of 0.99 [0.98-0.99] for classification of acute inpatient cEEG. CONCLUSIONS: Our model has the potential to identify cEEG monitoring admissions in larger cohorts and can serve as a tool to enable large-scale, administrative data-based studies of EEG utilization.

Real-World Continuous EEG Utilization and Outcomes in Hospitalized Patients With Acute Cerebrovascular Diseases.

PURPOSE: Continuous electroencephalography (cEEG) is recommended for hospitalized patients with cerebrovascular diseases and suspected seizures or unexplained neurologic decline. We sought to (1) identify areas of practice variation in cEEG utilization, (2) determine predictors of cEEG utilization, (3) evaluate whether cEEG utilization is associated with outcomes in patients with cerebrovascular diseases. METHODS: This cohort study of the Premier Healthcare Database (2014-2020), included hospitalized patients age >18 years with cerebrovascular diseases (identified by ICD codes). Continuous electroencephalography was identified by International Classification of Diseases (ICD)/Current Procedural Terminology (CPT) codes. Multivariable lasso logistic regression was used to identify predictors of cEEG utilization and in-hospital mortality. Propensity score-matched analysis was performed to determine the relation between cEEG use and mortality. RESULTS: 1,179,471 admissions were included; 16,777 (1.4%) underwent cEEG. Total number of cEEGs increased by 364% over 5 years (average 32%/year). On multivariable analysis, top five predictors of cEEG use included seizure diagnosis, hospitals with >500 beds, regions Northeast and South, and anesthetic use. Top predictors of mortality included use of mechanical ventilation, vasopressors, anesthetics, antiseizure medications, and age. Propensity analysis showed that cEEG was associated with lower in-hospital mortality (Average Treatment Effect -0.015 [95% confidence interval -0.028 to -0.003], Odds ratio 0.746 [95% confidence interval, 0.618-0.900]). CONCLUSIONS: There has been a national increase in cEEG utilization for hospitalized patients with cerebrovascular diseases, with practice variation. cEEG utilization was associated with lower in-hospital mortality. Larger comparative studies of cEEG-guided treatments are indicated to inform best practices, guide policy changes for increased access, and create guidelines on triaging and transferring patients to centers with cEEG capability.

Brain health scores to predict neurological outcomes from electronic health records.

BACKGROUND: Preserving brain health is a critical priority in primary care, yet screening for these risk factors in face-to-face primary care visits is challenging to scale to large populations. We aimed to develop automated brain health risk scores calculated from data in the electronic health record (EHR) enabling population-wide brain health screening in advance of patient care visits. METHODS: This retrospective cohort study included patients with visits to an outpatient neurology clinic at Massachusetts General Hospital, between January 2010 and March 2021. Survival analysis with an 11-year follow-up period was performed to predict the risk of intracranial hemorrhage, ischemic stroke, depression, death and composite outcome of dementia, Alzheimer's disease, and mild cognitive impairment. Variables included age, sex, vital signs, laboratory values, employment status and social covariates pertaining to marital, tobacco and alcohol status. Random sampling was performed to create a training (70%) set for hyperparameter tuning in internal 5-fold cross validation and an external hold-out testing (30%) set of patients, both stratified by age. Risk ratios for high and low risk groups were evaluated in the hold-out test set, using 1000 bootstrapping iterations to calculate 95% confidence intervals (CI). RESULTS: The cohort comprised 17,040 patients with an average age of 49 ± 15.6 years; majority were males (57 %), White (78 %) and non-Hispanic (80 %). The low and high groups average risk ratios [95 % CI] were: intracranial hemorrhage 0.46 [0.45-0.48] and 2.07 [1.95-2.20], ischemic stroke 0.57 [0.57-0.59] and 1.64 [1.52-1.69], depression 0.68 [0.39-0.74] and 1.29 [0.78-1.38], composite of dementia 0.27 [0.26-0.28] and 3.52 [3.18-3.81] and death 0.24 [0.24-0.24] and 3.96 [3.91-4.00]. CONCLUSIONS: Simple risk scores derived from routinely collected EHR accurately quantify the risk of developing common neurologic and psychiatric diseases. These scores can be computed automatically, prior to medical care visits, and may thus be useful for large-scale brain health screening.

How Many Patients Do You Need? Investigating Trial Designs for Anti-Seizure Treatment in Acute Brain Injury Patients.

Objectives: Epileptiform activity (EA) worsens outcomes in patients with acute brain injuries (e.g., aneurysmal subarachnoid hemorrhage [aSAH]). Randomized trials (RCTs) assessing anti-seizure interventions are needed. Due to scant drug efficacy data and ethical reservations with placebo utilization, RCTs are lacking or hindered by design constraints. We used a pharmacological model-guided simulator to design and determine feasibility of RCTs evaluating EA treatment. Methods: In a single-center cohort of adults (age >18) with aSAH and EA, we employed a mechanistic pharmacokinetic-pharmacodynamic framework to model treatment response using observational data. We subsequently simulated RCTs for levetiracetam and propofol, each with three treatment arms mirroring clinical practice and an additional placebo arm. Using our framework we simulated EA trajectories across treatment arms. We predicted discharge modified Rankin Scale as a function of baseline covariates, EA burden, and drug doses using a double machine learning model learned from observational data. Differences in outcomes across arms were used to estimate the required sample size. Results: Sample sizes ranged from 500 for levetiracetam 7 mg/kg vs placebo, to >4000 for levetiracetam 15 vs. 7 mg/kg to achieve 80% power (5% type I error). For propofol 1mg/kg/hr vs. placebo 1200 participants were needed. Simulations comparing propofol at varying doses did not reach 80% power even at samples >1200. Interpretation: Our simulations using drug efficacy show sample sizes are infeasible, even for potentially unethical placebo-control trials. We highlight the strength of simulations with observational data to inform the null hypotheses and assess feasibility of future trials of EA treatment.

Effects of epileptiform activity on discharge outcome in critically ill patients in the USA: a retrospective cross-sectional study.

BACKGROUND: Epileptiform activity is associated with worse patient outcomes, including increased risk of disability and death. However, the effect of epileptiform activity on neurological outcome is confounded by the feedback between treatment with antiseizure medications and epileptiform activity burden. We aimed to quantify the heterogeneous effects of epileptiform activity with an interpretability-centred approach. METHODS: We did a retrospective, cross-sectional study of patients in the intensive care unit who were admitted to Massachusetts General Hospital (Boston, MA, USA). Participants were aged 18 years or older and had electrographic epileptiform activity identified by a clinical neurophysiologist or epileptologist. The outcome was the dichotomised modified Rankin Scale (mRS) at discharge and the exposure was epileptiform activity burden defined as mean or maximum proportion of time spent with epileptiform activity in 6 h windows in the first 24 h of electroencephalography. We estimated the change in discharge mRS if everyone in the dataset had experienced a specific epileptiform activity burden and were untreated. We combined pharmacological modelling with an interpretable matching method to account for confounding and epileptiform activity-antiseizure medication feedback. The quality of the matched groups was validated by the neurologists. FINDINGS: Between Dec 1, 2011, and Oct 14, 2017, 1514 patients were admitted to Massachusetts General Hospital intensive care unit, 995 (66%) of whom were included in the analysis. Compared with patients with a maximum epileptiform activity of 0 to less than 25%, patients with a maximum epileptiform activity burden of 75% or more when untreated had a mean 22·27% (SD 0·92) increased chance of a poor outcome (severe disability or death). Moderate but long-lasting epileptiform activity (mean epileptiform activity burden 2% to <10%) increased the risk of a poor outcome by mean 13·52% (SD 1·93). The effect sizes were heterogeneous depending on preadmission profile-eg, patients with hypoxic-ischaemic encephalopathy or acquired brain injury were more adversely affected compared with patients without these conditions. INTERPRETATION: Our results suggest that interventions should put a higher priority on patients with an average epileptiform activity burden 10% or greater, and treatment should be more conservative when maximum epileptiform activity burden is low. Treatment should also be tailored to individual preadmission profiles because the potential for epileptiform activity to cause harm depends on age, medical history, and reason for admission. FUNDING: National Institutes of Health and National Science Foundation.

Association of Epileptiform Activity With Outcomes in Toxic-Metabolic Encephalopathy.

The clinical significance of epileptiform abnormalities (EAs) specific to toxic-metabolic encephalopathy (TME) is unknown. OBJECTIVES: To quantify EA burden in patients with TME and its association with neurologic outcomes. DESIGN SETTING AND PARTICIPANT: This is a retrospective study. A cohort of patients with TME and EA (positive) were age, Sequential Organ Failure Assessment Score, Acute Physiology and Chronic Health Evaluation II (APACHE-II) score matched to a cohort of TME patients without EA (control). Univariate analysis compared EA-positive patients against controls. Multivariable logistical regression adjusting for underlying disease etiology was performed to examine the relationship between EA burden and probability of poor neurologic outcome (modified Rankin Score [mRS] 4-6) at discharge. Consecutive admissions to inpatient floors or ICUs that underwent continuous electroencephalography (cEEG) monitoring at a single center between 2012 and 2019. Inclusion criteria were 1) patients with TME diagnosis, 2) age greater than 18 years, and 3) greater than or equal to 16 hours of cEEG. Patients with acute brain injury and cardiac arrest were excluded. MAIN OUTCOMES AND MEASURES: Poor neurologic outcome defined by mRS (mRS 4-6). RESULTS: One hundred sixteen patients were included, 58 with EA and 58 controls without EA, where matching was performed on age and APACHE-II score. The median age was 66 (Q1-Q3, 57-75) and median APACHE II score was 18 (Q1-Q3, 13-22). Overall cohort discharge mortality was 22% and 70% had a poor neurologic outcome. Peak EA burden was defined as the 12-hour window of recording with the highest prevalence of EAs. In multivariable analysis adjusted for Charlson Comorbidity Index and primary diagnosis, presence of EAs was associated with poor outcome (odds ratio 3.89; CI [1.05-14.2], p = 0.041). Increase in peak EA burden from 0% to 100% increased probability of poor discharge neurologic outcome by 30%. CONCLUSIONS AND RELEVANCE: Increasing burden of EA is associated with worse discharge outcomes in patients with TME. Future studies are needed to determine whether short-term treatment with anti-seizure medications while medically treating the underlying metabolic derangement improves outcomes.

Identifying inpatient hospitalizations with continuous electroencephalogram monitoring from administrative data.

Background: Continuous electroencephalography (cEEG) is increasingly utilized in hospitalized patients to detect and treat seizures. Epidemiologic and observational studies using administrative datasets can provide insights into the comparative and cost effectiveness of cEEG utilization. Defining patient cohorts that underwent acute inpatient cEEG from administrative datasets is limited by the lack of validated codes differentiating elective epilepsy monitoring unit (EMU) admissions from acute inpatient hospitalization with cEEG utilization. Our aim was to develop hospital administrative data-based models to identify acute inpatient admissions with cEEG monitoring and distinguish them from EMU admissions. Methods: This was a single center retrospective cohort study of adult (≥ 18 years old) inpatient admissions with a cEEG procedure (EMU or acute inpatient) between January 2016-April 2022. The gold standard for acute inpatient cEEG vs. EMU was obtained from the local EEG recording platform. An extreme gradient boosting model was trained to classify admissions as acute inpatient cEEG vs. EMU using administrative data including demographics, diagnostic and procedure codes, and medications. Results: There were 9,523 patients in our cohort with 10,783 hospital admissions (8.5% EMU, 91.5% acute inpatient cEEG); with average age of 59 (SD 18.2) years; 46.2% were female. The model achieved an area under the receiver operating curve of 0.92 (95% CI [0.91-0.94]) and area under the precision-recall curve of 0.99 [0.98-0.99] for classification of acute inpatient cEEG. Conclusions: Our model has the potential to identify cEEG monitoring admissions in larger cohorts and can serve as a tool to enable large-scale, administrative data-based studies of EEG utilization.

Association of Early Seizure Prophylaxis With Posttraumatic Seizures and Mortality: A Meta-analysis With Evidence Quality Assessment.

Purpose of the Review: To evaluate the quality of evidence about the association of primary seizure prophylaxis with antiseizure medication (ASM) within 7 days postinjury and the 18- or 24-month epilepsy/late seizure risk or all-cause mortality in adults with new-onset traumatic brain injury (TBI), in addition to early seizure risk. Results: Twenty-three studies met the inclusion criteria (7 randomized and 16 nonrandomized studies). We analyzed 9,202 patients, including 4,390 in the exposed group and 4,812 in the unexposed group (894 in placebo and 3,918 in no ASM groups). There was a moderate to serious bias risk based on our assessment. Within the limitations of existing studies, our data revealed a lower risk for early seizures in the ASM prophylaxis group compared with placebo or no ASM prophylaxis (risk ratio [RR] 0.43, 95% confidence interval [CI] 0.33-0.57, p < 0.00001, I 2 = 3%). We identified high-quality evidence in favor of acute, short-term primary ASM use to prevent early seizures. Early ASM prophylaxis was not associated with a substantial difference in the 18- or 24-month risk of epilepsy/late seizures (RR 1.01, 95% CI 0.61-1.68, p = 0.96, I 2 = 63%) or mortality (RR 1.16, 95% CI 0.89-1.51, p = 0.26, I 2 = 0%). There was no evidence of strong publication bias for each main outcome. The overall quality of evidence was low and moderate for post-TBI epilepsy risk and all-cause mortality, respectively. Summary: Our data suggest that the evidence showing no association between early ASM use and 18- or 24-month epilepsy risk in adults with new-onset TBI was of low quality. The analysis indicated a moderate quality for the evidence showing no effect on all-cause mortality. Therefore, higher-quality evidence is needed as a supplement for stronger recommendations.

Identification of patients with epilepsy using automated electronic health records phenotyping.

OBJECTIVE: Unstructured data present in electronic health records (EHR) are a rich source of medical information; however, their abstraction is labor intensive. Automated EHR phenotyping (AEP) can reduce the need for manual chart review. We present an AEP model that is designed to automatically identify patients diagnosed with epilepsy. METHODS: The ground truth for model training and evaluation was captured from a combination of structured questionnaires filled out by physicians for a subset of patients and manual chart review using customized software. Modeling features included indicators of the presence of keywords and phrases in unstructured clinical notes, prescriptions for antiseizure medications (ASMs), International Classification of Diseases (ICD) codes for seizures and epilepsy, number of ASMs and epilepsy-related ICD codes, age, and sex. Data were randomly divided into training (70%) and hold-out testing (30%) sets, with distinct patients in each set. We trained regularized logistic regression and an extreme gradient boosting models. Model performance was measured using area under the receiver operating curve (AUROC) and area under the precision-recall curve (AUPRC), with 95% confidence intervals (CI) estimated via bootstrapping. RESULTS: Our study cohort included 3903 adults drawn from outpatient departments of nine hospitals between February 2015 and June 2022 (mean age = 47 ± 18 years, 57% women, 82% White, 84% non-Hispanic, 70% with epilepsy). The final models included 285 features, including 246 keywords and phrases captured from 8415 encounters. Both models achieved AUROC and AUPRC of 1 (95% CI = .99-1.00) in the hold-out testing set. SIGNIFICANCE: A machine learning-based AEP approach accurately identifies patients with epilepsy from notes, ICD codes, and ASMs. This model can enable large-scale epilepsy research using EHR databases.

Classification of neurologic outcomes from medical notes using natural language processing.

Neurologic disability level at hospital discharge is an important outcome in many clinical research studies. Outside of clinical trials, neurologic outcomes must typically be extracted by labor intensive manual review of clinical notes in the electronic health record (EHR). To overcome this challenge, we set out to develop a natural language processing (NLP) approach that automatically reads clinical notes to determine neurologic outcomes, to make it possible to conduct larger scale neurologic outcomes studies. We obtained 7314 notes from 3632 patients hospitalized at two large Boston hospitals between January 2012 and June 2020, including discharge summaries (3485), occupational therapy (1472) and physical therapy (2357) notes. Fourteen clinical experts reviewed notes to assign scores on the Glasgow Outcome Scale (GOS) with 4 classes, namely 'good recovery', 'moderate disability', 'severe disability', and 'death' and on the Modified Rankin Scale (mRS), with 7 classes, namely 'no symptoms', 'no significant disability', 'slight disability', 'moderate disability', 'moderately severe disability', 'severe disability', and 'death'. For 428 patients' notes, 2 experts scored the cases generating interrater reliability estimates for GOS and mRS. After preprocessing and extracting features from the notes, we trained a multiclass logistic regression model using LASSO regularization and 5-fold cross validation for hyperparameter tuning. The model performed well on the test set, achieving a micro average area under the receiver operating characteristic and F-score of 0.94 (95% CI 0.93-0.95) and 0.77 (0.75-0.80) for GOS, and 0.90 (0.89-0.91) and 0.59 (0.57-0.62) for mRS, respectively. Our work demonstrates that an NLP algorithm can accurately assign neurologic outcomes based on free text clinical notes. This algorithm increases the scale of research on neurological outcomes that is possible with EHR data.

Development of Expert-Level Classification of Seizures and Rhythmic and Periodic Patterns During EEG Interpretation.

BACKGROUND AND OBJECTIVES: Seizures (SZs) and other SZ-like patterns of brain activity can harm the brain and contribute to in-hospital death, particularly when prolonged. However, experts qualified to interpret EEG data are scarce. Prior attempts to automate this task have been limited by small or inadequately labeled samples and have not convincingly demonstrated generalizable expert-level performance. There exists a critical unmet need for an automated method to classify SZs and other SZ-like events with expert-level reliability. This study was conducted to develop and validate a computer algorithm that matches the reliability and accuracy of experts in identifying SZs and SZ-like events, known as "ictal-interictal-injury continuum" (IIIC) patterns on EEG, including SZs, lateralized and generalized periodic discharges (LPD, GPD), and lateralized and generalized rhythmic delta activity (LRDA, GRDA), and in differentiating these patterns from non-IIIC patterns. METHODS: We used 6,095 scalp EEGs from 2,711 patients with and without IIIC events to train a deep neural network, SPaRCNet, to perform IIIC event classification. Independent training and test data sets were generated from 50,697 EEG segments, independently annotated by 20 fellowship-trained neurophysiologists. We assessed whether SPaRCNet performs at or above the sensitivity, specificity, precision, and calibration of fellowship-trained neurophysiologists for identifying IIIC events. Statistical performance was assessed by the calibration index and by the percentage of experts whose operating points were below the model's receiver operating characteristic curves (ROCs) and precision recall curves (PRCs) for the 6 pattern classes. RESULTS: SPaRCNet matches or exceeds most experts in classifying IIIC events based on both calibration and discrimination metrics. For SZ, LPD, GPD, LRDA, GRDA, and "other" classes, SPaRCNet exceeds the following percentages of 20 experts-ROC: 45%, 20%, 50%, 75%, 55%, and 40%; PRC: 50%, 35%, 50%, 90%, 70%, and 45%; and calibration: 95%, 100%, 95%, 100%, 100%, and 80%, respectively. DISCUSSION: SPaRCNet is the first algorithm to match expert performance in detecting SZs and other SZ-like events in a representative sample of EEGs. With further development, SPaRCNet may thus be a valuable tool for an expedited review of EEGs. CLASSIFICATION OF EVIDENCE: This study provides Class II evidence that among patients with epilepsy or critical illness undergoing EEG monitoring, SPaRCNet can differentiate (IIIC) patterns from non-IIIC events and expert neurophysiologists.

Interrater Reliability of Expert Electroencephalographers Identifying Seizures and Rhythmic and Periodic Patterns in EEGs.

BACKGROUND AND OBJECTIVES: The validity of brain monitoring using electroencephalography (EEG), particularly to guide care in patients with acute or critical illness, requires that experts can reliably identify seizures and other potentially harmful rhythmic and periodic brain activity, collectively referred to as "ictal-interictal-injury continuum" (IIIC). Previous interrater reliability (IRR) studies are limited by small samples and selection bias. This study was conducted to assess the reliability of experts in identifying IIIC. METHODS: This prospective analysis included 30 experts with subspecialty clinical neurophysiology training from 18 institutions. Experts independently scored varying numbers of ten-second EEG segments as "seizure (SZ)," "lateralized periodic discharges (LPDs)," "generalized periodic discharges (GPDs)," "lateralized rhythmic delta activity (LRDA)," "generalized rhythmic delta activity (GRDA)," or "other." EEGs were performed for clinical indications at Massachusetts General Hospital between 2006 and 2020. Primary outcome measures were pairwise IRR (average percent agreement [PA] between pairs of experts) and majority IRR (average PA with group consensus) for each class and beyond chance agreement (κ). Secondary outcomes were calibration of expert scoring to group consensus, and latent trait analysis to investigate contributions of bias and noise to scoring variability. RESULTS: Among 2,711 EEGs, 49% were from women, and the median (IQR) age was 55 (41) years. In total, experts scored 50,697 EEG segments; the median [range] number scored by each expert was 6,287.5 [1,002, 45,267]. Overall pairwise IRR was moderate (PA 52%, κ 42%), and majority IRR was substantial (PA 65%, κ 61%). Noise-bias analysis demonstrated that a single underlying receiver operating curve can account for most variation in experts' false-positive vs true-positive characteristics (median [range] of variance explained ([Formula: see text]): 95 [93, 98]%) and for most variation in experts' precision vs sensitivity characteristics ([Formula: see text]: 75 [59, 89]%). Thus, variation between experts is mostly attributable not to differences in expertise but rather to variation in decision thresholds. DISCUSSION: Our results provide precise estimates of expert reliability from a large and diverse sample and a parsimonious theory to explain the origin of disagreements between experts. The results also establish a standard for how well an automated IIIC classifier must perform to match experts. CLASSIFICATION OF EVIDENCE: This study provides Class II evidence that an independent expert review reliably identifies ictal-interictal injury continuum patterns on EEG compared with expert consensus.

Automated EEG-based prediction of delayed cerebral ischemia after subarachnoid hemorrhage.

OBJECTIVE: Delayed cerebral ischemia (DCI) is a leading complication of aneurysmal subarachnoid hemorrhage (SAH) and electroencephalography (EEG) is increasingly used to evaluate DCI risk. Our goal is to develop an automated DCI prediction algorithm integrating multiple EEG features over time. METHODS: We assess 113 moderate to severe grade SAH patients to develop a machine learning model that predicts DCI risk using multiple EEG features. RESULTS: Multiple EEG features discriminate between DCI and non-DCI patients when aligned either to SAH time or to DCI onset. DCI and non-DCI patients have significant differences in alpha-delta ratio (0.08 vs 0.05, p < 0.05) and percent alpha variability (0.06 vs 0.04, p < 0.05), Shannon entropy (p < 0.05) and epileptiform discharge burden (205 vs 91 discharges per hour, p < 0.05) based on whole brain and vascular territory averaging. Our model improves predictions by emphasizing the most informative features at a given time with an area under the receiver-operator curve of 0.73, by day 5 after SAH and good calibration between 48-72 hours (calibration error 0.13). CONCLUSIONS: Our proposed model obtains good performance in DCI prediction. SIGNIFICANCE: We leverage machine learning to enable rapid, automated, multi-featured EEG assessment and has the potential to increase the utility of EEG for DCI prediction.

Electroencephalogram in the intensive care unit: a focused look at acute brain injury.

Over the past decades, electroencephalography (EEG) has become a widely applied and highly sophisticated brain monitoring tool in a variety of intensive care unit (ICU) settings. The most common indication for EEG monitoring currently is the management of refractory status epilepticus. In addition, a number of studies have associated frequent seizures, including nonconvulsive status epilepticus (NCSE), with worsening secondary brain injury and with worse outcomes. With the widespread utilization of EEG (spot and continuous EEG), rhythmic and periodic patterns that do not fulfill strict seizure criteria have been identified, epidemiologically quantified, and linked to pathophysiological events across a wide spectrum of critical and acute illnesses, including acute brain injury. Increasingly, EEG is not just qualitatively described, but also quantitatively analyzed together with other modalities to generate innovative measurements with possible clinical relevance. In this review, we discuss the current knowledge and emerging applications of EEG in the ICU, including seizure detection, ischemia monitoring, detection of cortical spreading depolarizations, assessment of consciousness and prognostication. We also review some technical aspects and challenges of using EEG in the ICU including the logistics of setting up ICU EEG monitoring in resource-limited settings.

Dexmedetomidine and Other Analgosedatives Alter Pupil Characteristics in Critically Ill Patients.

In critically ill patients with neurologic disease, pupil examination abnormalities can signify evolving intracranial pathology. Analgesic and sedative medications (analgosedatives) target pupillary pathways, but it remains unknown how analgosedatives alter pupil findings in the clinical care setting. We assessed dexmedetomidine and other analgosedative associations with pupil reactivity and size in a heterogeneous cohort of critically ill patients with acute intracranial pathology. DESIGN: Retrospective cohort study. SETTING: Two neurologic ICUs between 2016 and 2018. PATIENTS: Critically ill adult patients with pupil measurements within 60 minutes of analgosedative administration. Patients with a history of intrinsic retinal pathology, extracranial injury, inaccessible brain imaging, or no Glasgow Coma Scale (GCS) data were excluded. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We used mixed-effects linear regression accounting for intrapatient correlations and adjusting for sex, age, GCS score, radiographic mass effect, medication confounders, and ambient light. We tested the association between an initiation or increased IV infusion of dexmedetomidine and pupil reactivity (Neurologic Pupil Index [NPi]) and resting pupil size (mm) obtained using NeurOptics NPi-200 (NeurOptics, Irvine, CA) pupillometer. Of our 221 patients with 9,897 pupil observations (median age, 60 [interquartile range, 50-68]; 59% male), 37 patients (166 pupil observations) were exposed to dexmedetomidine. Dexmedetomidine was associated with higher average NPi (ß = 0.18 per 1 unit increase in rank-normalized NPi ± 0.04; p < 0.001) and smaller pupil size (ß = -0.25 ± 0.05; p < 0.001). Exploratory analyses revealed that acetaminophen was associated with higher average NPi (ß = 0.04 ± 0.02; p = 0.02) and that most IV infusion analgosedatives including propofol, fentanyl, and midazolam were associated with smaller pupil size. CONCLUSIONS: Dexmedetomidine is associated with higher pupil reactivity (high NPi) and smaller pupil size in a cohort of critically ill patients with neurologic injury. Familiarity with expected pupil changes following analgosedative administration is important for accurate interpretation of pupil examination findings, facilitating optimal management of patients with acute intracranial pathology.

Measuring expertise in identifying interictal epileptiform discharges.

OBJECTIVE: Interictal epileptiform discharges on EEG are integral to diagnosing epilepsy. However, EEGs are interpreted by readers with and without specialty training, and there is no accepted method to assess skill in interpretation. We aimed to develop a test to quantify IED recognition skills. METHODS: A total of 13,262 candidate IEDs were selected from EEGs and scored by eight fellowship-trained reviewers to establish a gold standard. An online test was developed to assess how well readers with different training levels could distinguish candidate waveforms. Sensitivity, false positive rate and calibration were calculated for each reader. A simple mathematical model was developed to estimate each reader's skill and threshold in identifying an IED, and to develop receiver operating characteristics curves for each reader. We investigated the number of IEDs needed to measure skill level with acceptable precision. RESULTS: Twenty-nine raters completed the test; nine experts, seven experienced non-experts and thirteen novices. Median calibration errors for experts, experienced non-experts and novices were -0.056, 0.012, 0.046; median sensitivities were 0.800, 0.811, 0.715; and median false positive rates were 0.177, 0.272, 0.396, respectively. The number of test questions needed to measure those scores was 549. Our analysis identified that novices had a higher noise level (uncertainty) compared to experienced non-experts and experts. Using calculated noise and threshold levels, receiver operating curves were created, showing increasing median area under the curve from novices (0.735), to experienced non-experts (0.852) and experts (0.891). SIGNIFICANCE: Expert and non-expert readers can be distinguished based on ability to identify IEDs. This type of assessment could also be used to identify and correct differences in thresholds in identifying IEDs.